Structure optimization of prior-knowledge-guided neural networks

نویسندگان

چکیده

Prior-knowledge use in neural networks, for example, knowledge of a physical system, allows network training to be tailored specific problems. Literature shows that prior-knowledge enhances predictive performance. Research date focuses on parametric optimization rather than structure optimization. We present new framework optimize the using prior-knowledge. This is achieved through optimizing number hidden units via line search and cross-validation empirical error eliminate data-set/model-structure application dependency guided networks. In addition model step, we propose utilizing prior errors as part performance index improve generalization. Results demonstrate proposed model’s prediction accuracy consistency convex data sets with unique minimum non-convex multi-modal sets. The presented results yield understanding physics-guided networks terms their structural

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Integrating Statistical Prior Knowledge into Convolutional Neural Networks

In this work we show how to integrate prior statistical knowledge, obtained through principal components analysis (PCA), into a convolutional neural network in order to obtain robust predictions even when dealing with corrupted or noisy data. Our network architecture is trained end-to-end and includes a specifically designed layer which incorporates the dataset modes of variation discovered via...

متن کامل

Structure optimization of neural networks for evolutionary design optimization

We study the use of neural networks (NN) as approximate models for fitness evaluation in evolutionary computation. To improve the quality of the NN models, structure optimization of these NNs is applied with respect to two different criteria: One is the commonly used approximation error, and the other is the ability of the NNs to learn different problems of a common class of problems. Simulatio...

متن کامل

Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation

Human pose estimation using deep neural networks aims to map input images with large variations into multiple body keypoints which must satisfy a set of geometric constraints and inter-dependency imposed by the human body model. This is a very challenging nonlinear manifold learning process in a very high dimensional feature space. We believe that the deep neural network, which is inherently an...

متن کامل

Structure-guided forcefield optimization

Accurate modeling of biomolecular systems requires accurate forcefields. Widely used molecular mechanics (MM) forcefields obtain parameters from experimental data and quantum chemistry calculations on small molecules but do not have a clear way to take advantage of the information in high-resolution macromolecular structures. In contrast, knowledge-based methods largely ignore the physical chem...

متن کامل

Feedforward Neural Networks – Architecture Optimization and Knowledge Extraction

Feedforward neural networks represent a well-established computational model, which can be used for solving complex tasks requiring large data sets. When dealing with this kind of problems, the main requirements will be the speed of the learning process and the ability to generalize well the extracted knowledge. To satisfy these demands, adequate initial parameters of the model – like number of...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2022

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2022.03.008